data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language - nikkie-memos

data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language

https://ai.facebook.com/research/data2vec-a-general-framework-for-self-supervised-learning-in-speech-vision-and-language (2022/01)

https://arxiv.org/abs/2202.03555

Figure.1がdata2vec論文のサマリと思われる

data2vec論文 NLPの部分メモ

なんもわからん人の論文読み会（をきっかけに読んだ）メモ

data2vec論文 Abstract

data2vec論文 1.Introduction

data2vec論文 2.Related work

DL輪読会スライド https://www.slideshare.net/DeepLearningJP2016/dldata2vec-a-general-framework-for-selfsupervised-learning-in-speech-vision-and-language-251106954

Byte Pair Encoding (BPE)